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Make your web space 0 better place: 



E 



User Registration 

By registering you will be able 
to provide more useful feedback 
to the sites that you visit. 
Once you complete the following 
information, a cookie will store an 
ID with your browser that will 
identify your unique demographics 
with the ratings you make on a 
given page. 

You only need to complete the 
following information once and it 
will be associated with your 
ratings. You will use your password 
to update this information online. 



Nickname: [ 
Password: 52 "^f 
E-mail Address: [ 
Gender: 
Age: 

Industry: 



52 



^2> H select gender ^ 



select age |p 1 



[select industry If*! 



Employment Status: | select status IF^R 
1 1 Register || 

Registration Tips 

• Please specify a "valid" email address as 
we will send your password to this email 
address. 

• When selecting your user name, please 
use only alphanumeric characters. No 
special characters are accepted, such as 
<space>, /, !,~ etc. 

• Please do not select a user name that 
contains words that others may consider 
to be offensive; no swear words will be 
permitted. 

• You can change your password at any 
time by selecting Edit Profile from the 
Help page. 

Please read our Privacy Policy for 
information on how we protect user privacy. 



1[~ T ~1 I ll Internet zone 



iDDone 



38 



05/03/2004, EAST version: 1.4.1 



U.S. Patent Jul. 16, 2002 Sheet 6 of 6 US 6,421,724 Bl 




05/03/2004, EAST Version: 1.4.1 



US 6,4: 

1 

WEB SITE RESPONSE MEASUREMENT 
TOOL 

FIELD OF THE INVENTION 

The present invention relates to web site response mea- 
surement tools. More particularly, the present invention 
relates to tools for collecting and reporting user interaction 
with and response to a web site on a page-by-page basis. 

BACKGROUND INFORMATION 

As computer networking technology continues to 
advance, many companies are scrambling to take advantage 
of intranets, extranets and the Internet to provide Web sites 
containing information about their business, to conduct 
transactions, and to build relationships. The Internet in 
particular has become an exciting new electronic market- 
place that companies are exploring. A typical web site 
comprises a plurality of individual web pages linked 
together in a predetermined topography. Each web page 
provides specific categorical information. A user navigates 
through the web site by "clicking" on links embedded on the 
individual Web pages. The web sites typically provide 
information about the company and its products and/or 
services and/or are used to conduct transactions, or present 
advertisements. Web sites can be visited by employees, 
customers, investors, business partners, prospects and many 
others. 

Employees can be looking for guidance and support 
information about the company. Customers may be making 
decisions about whether to do business with a company 
based on the image presented by the company's web site or 
actually conducting business via the Internet. Investors may 
be assessing the company's ability to create value based on 
its web site. Business partners and prospects may be search- 
ing for companies that are a good fit for them based on 
information presented in Internet web sites. 

In order to improve the effectiveness of the web as a 
media, it would be helpful to collect and evaluate user 
reaction to web sites on a page by page basis. Thus, there is 
a need for a web site measurement tool for measuring user 
reaction to web sites through feedback provided by users. 

Unique, idiosyncratic, unpredictable and individualized 
methods of requesting user feedback do not provide the kind 
of consistent and reliable data needed to properly evaluate a 
web site. Nor do they result in a consistent, high level of 
response. Users will typically not employ a response method 
that they must learn, that requires them to leave the page of 
interest, that takes an unpredictable length of time or that 
requests information they are not prepared to divulge. 

Furthermore, inconsistent methods of obtaining user feed- 
back prevent web site owners from comparing user reaction 
across web sites. Capturing feedback data on a web site 
level, rather than web page level, leads to confusion for users 
giving feedback as well as for web site owners interpreting 
the feedback data because definition and context of the data 
is ambiguous. Thus, there is a need for a web site response 
measurement tool that captures user reaction feedback data 
on a page-by-page basis, using a consistent, fast, convenient 
and predictable method to allow the feedback data to be 
compared across web pages and web sites throughout the 
world wide web. 

To further increase the value of the user reaction, it is also 
desirable to associate user demographic information with a 
user's reaction feedback data. In this manner, a web site 
owner can tailor a web site to target a specific market 
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segment by customer demographic. In order to encourage 
users to provide demographic information, a method for 
collecting the data that does not require the user to download 
special collection software or submit their information more 

5 than once must be designed. 

Once user reaction feedback data is collected, it needs to 
be organized and reported in a format that is easy to 
understand and analyze. It is important that the data be 
presented to the web site owner in a fashion that emphasizes 

10 the site topography so that valuable page level data is not 
obscured. This requires unique navigational tools. 

As described above, there is a need for a web site 
measurement tool that collects user reaction data on a 
page-by-page basis. Preferably, user demographic data is 

15 collected and reported with the user reaction data. The 
collected data must be reported in an easy-to-understand and 
analyze format on a page-by-page basis that emphasizes the 
web site's topography. Unique online self-serve navigational 
system linking user feedback to specific site pages and 

20 topography would facilitate the owner's interpretation and 
understanding of the user feedback data. 

SUMMARY OF THE INVENTION 

These needs and others are satisfied by the web site 
25 response measurement tool of the present invention. A web 
site response measurement tool according to the present 
invention comprises a user reaction feedback mechanism, 
means for consistently collecting user response data, means 
3q for organizing user response data on a page-by-page basis 
and means for reporting the user response data on a page- 
by-page basis and at an aggregate level through a unique 
online self -serve navigation system linking user feedback to 
site topography. The present invention also provides a means 
to collect demographic data for a user and associate it to that 
35 user. 

The user reaction feedback mechanism is located on one 
or more web pages on a typical site. This allows a user to rate 
each page independently. The user reaction feedback mecha- 

^ nism provides a language-independent 5-point rating scale 
for rating each of the web pages. The user reaction feedback 
mechanism can further include a user diagnostic feedback 
mechanism that provides a series of questions designed to 
obtain user response on a plurality of aspects of each of the 

45 web pages. The questions can relate to the user's reaction to 
the content, design and usability of each web page. 

Preferably, the user reaction feedback mechanism further 
comprises an icon placed in a specific viewable location on 
each web page relative to the web browser border. The icon 

50 is configured to remain in the viewable location relative to 
the browser border even as the user scrolls through the web 
page. The user feedback mechanism is easy-to-use, fact, 
predictable and consistent across pages and across sites to 
encourage usage. It may also be placed in the "masthead" 

55 area of a site and, thus, viewable from every page. 

The web site response measurement tool can further 
include a user registration system for collecting user demo- 
graphics information. The means for organizing the data 
associates the collected user demographics information with 

60 the user response data and the means for reporting associates 
the user demographics information with the user response 
data. 

A self-serve online report is generated by the means for 
reporting. The report allows web site owners to navigate 
65 through their web site following the linked topography of 
the web site to view the user response data. The report 
provides a plurality of display pages for displaying the user 
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response data on a page-by-page basis with each of the nism 24 comprises a Java®-script computer program con- 
display pages comprising user response data for a corre- figured to run on the user workstation 14 when a user 
sponding web page along with links to each of the pages accesses a web page 32. 

linked from this page. A user accesses a web page 32 residing on the web site 

The means for organizing the data further includes means 5 server 16 from the user workstation 14 via the Internet 22 

for quantifying the user reaction data into a standardized using an Internet browser 34. Typically, only a portion of the 

measure. web page 32 is viewable in the browser 34 window at a time. 

A user can scroll through the web page 32 changing the 

BRIEF DESCRIPTION OF THE DRAWINGS viewable portion. 

+ . , - . , . ,. c 10 In a preferred embodiment, the user reaction feedback 

FIG. 1 is a schematic block diagram of a computer mechanism 24 „ an icon 36 m a prcdctcrmined 

network employing a web site measurement tool according location felalivc ^ browsef wmdow ^ 3g Qn ^ 

to the present invention; viewable q£ ^ web page ^ ^ icon ^ ^ 

FIG. 2 is a screen capture of a computer screen displaying configured to remain in the predetermined location as the 

a web page including an icon representing the web site 15 user scrolls through the web page 32. Alternatively, the icon 

measurement tool of FIG. 1; 36 can be located in me mast head 35 area. 

FIG. 3 is a screen capture of a computer screen displaying As the user moves the mouse pointer 40 over the icon 36, 

a web page including the icon-based user reaction feedback the icon 36 changes into a five-point scale 41 and question 

mechanism of FIG. 2 showing a five-point rating scale; mark 42. The user can rate his/her reaction to the web page 

FIG. 4 is a screen capture of a computer screen displaying 20 32 by selecting a rating from the five point scale 41. The 

a web page including an alternate user reaction feedback rating is selected by moving the mouse pointer 40 over the 

mechanism of FIG. 2 showing a series of three five-point desired rating and clicking the mouse button (not shown), 

rating scales; Selecting the question mark 42 provides the user with 

FIG. 5 is a screen capture of a user demographic infor- detailed instruction on how to use the measurement tool 10. 

mation entry screen according to the present invention; and 25 Upon selection of a rating by a user, the user reaction 

FIG. 6 is a screen capture of a computer screen showing feedback mechanism 24 stores the following information in 

a topographical linked report according to the present inven- a data file 25 on the dala co ^on and reporting server 20: 

tion. P a ge identification code; 

Internet protocol address; 

DETAILED DESCRIPTION OF THE rating value (++, +, +/-, — ); 

PREFERRED EMBODIMENT rating time and date; 

In accordance with the present invention, a user response time s P ent on P a 8 e before ratin S iv > 

measurement tool is described that provides distinct advan- ID associated with the person rating the page (and desir- 

tages when compared to those of the prior art. The invention 35 abl y associated demographics); and 

can best be understood with reference to the accompanying session ID. 

drawing figures. ^ In this manner, user reaction data to a web site 30 can be 

Referring now to the Figures, a web site response mea- e°U«cted on a page-by-page basis providing definition and 

surement tool according to the present invention is generally context to the data. 

designated by reference numeral 10. The web site response 40 ^ user reactlon feedback mechanism 24 can also 

measurement tool 10 is configured to operate on web pages mclude a user diagnostic feedback mechanism 46. This icon 

in a computer network 12, such as an intranet, extranet or the 36 15 similar but ™ n be discriminated through color or other 

Internet means from the single scale 41 measurement icon to main- 

, c , , _ . . 4 tain predictability and consistency from a user perspective. 

In a preferred embodiment, a web site response measure- AC ^* a - #• c jl 1 1 • • n 

♦ . 1 1 n < • - .« 4 . f. 45 The user diagnostic feedback mechanism 46 is configured to 

ment tool 10 according to the present invention operates to „ ®. - tU , An . . i P , 4 

4 . z t f * l . present a series of three scales 47 to the user designed to 

measure user reaction to an Internet web site on a page-by- ^ ^ ^ reaction ^ * f ^ 

page basis. In this embodiment, the computer ne work 12 web 32 such as c ^ * the web 

comprises a user workstation 14, a web site server 16, a web r & ' 6 J 

site owner user workstation 18 and a data collection and „ P f' tU ^ *u« • 1* • * a* ♦ i 

^. u . • • t i m . 50 In this instance, the icon 36 is configured to open to reveal 

reporting server 20 all connected via the Internet 22. ,„i-V e u • m . *u « • i 

v 6 three scales 47 of 5 points each similar to the previous single 

The web site measurement tool 10 comprises a user 41. jh e scales 47 are labeled "Content," "Usability" 

reaction feedback mechanism 24, a data collection program and "Design." The scales 47 are configured to rotate in 

26 and a system for reporting and navigating the collected position each time they are opened to eliminate response 

data 28. The user reaction feedback mechanism 24 resides 55 bj as 

on the web site server 16 until a user requests the page. At The user's responses to each of the questions presented by 

this point the user reaction feedback mechanism is down- tne user diagnostic feedback mechanism 46, along with the 

loaded onto the user workstation 14 and is embedded in the information specified above, is also stored in the database 25 

user's browser. The data collection program 26 and system on the web site server 16. 

for reporting the collected data 28 reside on the data col- 60 ^th the user reaction feedback mechanism 24, the 

lection and reporting server 20. ^ diagnostic feedback mechanism 46 collects user 

The user reaction feedback mechanism 24 is incorporated responses on a page-by-page basis. In this manner, the web 

into certain web pages 32 residing on the web site server 16. site owner can use the data collected by the user diagnostic 

For example, the user reaction feedback mechanism 24 feedback mechanism 46 to identify specific aspects of a web 

comprises a client side script that is activated every time a 65 page 32 that can be improved. 

web page 32 from the web site 30 is accessed. In the Additionally, a user registration system 48 can be 

preferred embodiment, the user reaction feedback mecha- included in the user reaction feedback mechanism 24 for 
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collecting user demographic information. In a preferred 
embodiment, the user registration system 48 is implemented 
as a web page registration page 50. As shown in FIG. 5, the 
web registration page 50 collects the following user infor- 
mation: 5 
Nickname: 

Email address (optional); 

Password; 

Gender; 

Age (in ranges 10 or less, 11-17, 18-24, etc.); 10 
Industry of user; 

Employment (full-time, part-time, student, retired, 
etc.). 

Additionally, the registration page 50 can collect the fol- 
lowing information: 15 

Size of household (1, 2, 3, 4, 4+); 

Highest level of education; 

Household income range; 

Country of residence. 20 

The registration page 50 includes entry fields 52 into 
which the user is prompted to enter the above demographic 
information. This demographic information can be used by 
the web site owner to tailor their page revisions to appeal to 
a certain segment of users. 25 

User demographic information is stored in an independent 
database 27. Each user is assigned a unique ID, preferably 
stored as a cookie on the user's workstation 14, which is 
associated with their demographic profile. On subsequent 
use of the icon 36 by a registered user, the icon 36 may 30 
confirm that it recognizes the user by displaying their 
nickname and the word "thanks." 

The web site response measurement tool 10 of the present 
invention is configured to allow a web site owner to request 
reports showing user reaction to his/her web site 30 on a 35 
page-by-page basis. The web site owner requests a report by 
logging into the data collection and reporting server 20 via 
the Internet 22 from the web site owner's user workstation 
18. 

When attempting to download the rating software onto a 40 
web site, the web site owner is prompted by the data 
collection and reporting server 20 to enter the following 
information: First Name, Last Name, Title, Company, 
Address, Email Address, Phone Number, Industry, and web 
site address. The data collection and reporting server 20 also 45 
sends a notification that the web site owner's web site 30 
will be crawled and a copy of a License Agreement regard- 
ing the providing of a report to the web site owner. 

Upon receiving the requested information from the web 
site owner, the data collection and reporting server 20 50 
verifies the user ID and password by Email via the Internet 
22. The data collection and reporting server 20 conducts a 
web crawl to identify all of the web pages associated with 
this web site 30. This crawl is repeated at a predetermined 
frequency, and may also be triggered by receiving data about 55 
a web page 32. This information and site map are collected 
and organized by the data collection program 26 and stored 
in a data base 44 on the data collection and reporting 
workstation 20. 

All user reaction and demographic data and client regis- 60 
tration data is stored in the databases 25, 27 and 44. 
Submittal of this information is via an SSL secure server. All 
reports are generated on the fly from the databases 25, 27 
and 44 by the data reporting system 28 on the data collection 
and reporting server 20. The web site owner can access the 65 
data collection and reporting server 20 to view the graphical 
report 54 by using their user ID and password assigned. 
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There are three possible ways to navigate to user response 
data for a specific page: 1) via a scan report categorizing 
average page ratings by color, value of the rating and 
number of ratings on a single graph; 2) by a list of pages; and 
3) from the web page. FIG. 6 illustrates a preferred scan 
report. 

In a preferred embodiment, the data collection and report- 
ing server 20 is configured to provide an initial summary 
report including the user reaction data on a five-point scale 
on a page-by-page basis for free. The web site server 20 is 
also configured to offer more detailed diagnostic reports 
including information collected by the user diagnostic feed- 
back mechanism 46 and user demographic information 
collected by the user registration system 48 for a fee. 
Payment can be accepted by prepaid accounts, credit card 
submissions, telefaxed invoice or other means. 

It will be apparent to those skilled in the art that modi- 
fications may be made without departing from the spirit and 
scope of the invention. Accordingly, it is not intended that 
the invention be limited except as may be necessary in view 
of the appended claims. 

What is claimed is: 

1. A system for measuring subjective user reaction con- 
cerning a particular web page of a website, comprising: 

a first icon viewable on the particular web page indepen- 
dent of input from a user subsequent to the user 
accessing the particular web page, the first icon solic- 
iting a subjective user reaction to the particular web 
page as a whole from the user independent of input 
from the user subsequent to the user accessing the 
particular web page, the first icon operable to receive 
user input indicating a desire to provide a subjective 
user reaction to the particular web page as a whole, the 
user input causing a second icon to become viewable 
on the particular web page, the second icon comprising 
a plurality of multi-level rating scales for rating the 
particular web page, each multi-level rating scale being 
associated with a particular characteristic of the par- 
ticular web page including at least one positive rating, 
a neutral rating, and at least one negative rating; and 

software associated with the second icon and operable to 
receive the subjective user reaction to the particular 
web page as a whole for reporting to a website owner. 

2. The system of claim 1, wherein each characteristic of 
the particular web page is selected from the group consisting 
of content, design, and usability. 

3. A system for measuring subjective user reaction con- 
cerning a particular web page of a website, comprising: 

a first icon viewable on the particular web page indepen- 
dent of input from a user subsequent to the user 
accessing the particular web page, the first icon solic- 
iting a subjective user reaction to the particular web 
page as a whole from the user independent of input 
from the user subsequent to the user accessing the 
particular web page, the first icon comprising a symbol 
selected from the group consisting of a plus sign, a 
minus sign, and a dynamic symbol that changes peri- 
odically from a plus sign to a minus sign and vice versa, 
the first icon operable to receive user input indicating a 
desire to provide a subjective user reaction to the 
particular web page as a whole, the user input causing 
a second icon to become viewable on the particular web 
page, the second icon providing the user an opportunity 
to provide a subjective user reaction to the particular 
web page as a whole; and 

software associated with the second icon and operable to 
receive the subjective user reaction to the particular 
web page as a whole for reporting to a website owner. 
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4. A system for measuring subjective user reactions con- 
cerning a plurality of particular web pages of a website, 
comprising: 

a first icon viewable on each particular web page inde- 
pendent of input from a user subsequent to the user 5 
accessing the particular web page, the first viewable 
icon indicating to each user that has accessed the 
particular web page an opportunity to provide a sub- 
jective user reaction to the particular web page as a 
whole, the first viewable icon operable to receive user 10 
input indicating a desire to provide a subjective user 
reaction to the particular web page as a whole, the user 
input causing a second icon to become viewable on the 
particular web page; 

the second viewable icon, operable to solicit a subjective 15 
user reaction to the particular web page as a whole from 
each user that has accessed the particular web page and 
provided user input via the first icon indicating a desire 
to provide a subjective user reaction to the particular 
web page as a whole, the second icon being substan- 20 
tially similar for each particular web page, the second 
icon comprising a multi-level rating scale for rating the 
particular web page, the multi-level rating scale includ- 
ing at least one positive rating, a neutral rating, and at 
least one negative rating; and 25 

software that is associated with the first and second icons 
and incorporated into the software for each particular 
web page such that the user need not download soft- 
ware separate from the particular web page to provide 3Q 
the subjective user reaction to the particular web page, 
the software associated with the first and second icons 
operable to receive the subjective user reactions to the 
particular web pages for reporting to a website owner. 

5. A method of measuring a subjective user reaction 35 
concerning a particular web page of a website, comprising: 

using a first icon viewable on the particular web page 
independent of input from a user subsequent to the user 
accessing the particular web page to solicit a subjective 
user reaction to the particular web page as a whole from 40 
the user independent of input from the user subsequent 
to the user accessing the particular web page, the first 
icon operable to receive user input indicating a desire 
to provide a subjective user reaction to the particular 
web page as a whole; 45 

causing a second icon to become viewable on the par- 
ticular web page in response to receiving the user input 
indicating a desire to provide a subjective user reaction 
to the particular web page as a whole, the second icon 
comprising a plurality of multi-level rating scales for 50 
rating the particular web page, each multi-level rating 
scale being associated with a particular characteristic of 
the particular web page including at least one positive 
rating, a neutral rating, and at least one negative rating; 
and 55 

using software associated with the second icon to receive 
the subjective user reaction to the particular web page 
as a whole for reporting to a website owner. 

6. The method of claim 5, wherein each characteristic of 
the particular web page is selected from the group consisting 60 
of content, design, and usability. 

7. A method of measuring a subjective user reaction 
concerning a particular web page of a website, comprising: 

using a first icon viewable on the particular web page 
independent of input from a user subsequent to the user 65 
accessing the particular web page to solicit a subjective 
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user reaction to the particular web page as a whole from 
the user independent of input from the user subsequent 
to the user accessing the particular web page, the first 
icon comprising a symbol selected from the group 
consisting of a plus sign, a minus sign, and a dynamic 
symbol that changes periodically from a plus sign to a 
minus sign and vice versa, the first icon operable to 
receive user input indicating a desire to provide a 
subjective user reaction to the particular web page as a 
whole; 

causing a second icon to become viewable on the par- 
ticular web page in response to receiving user input 
indicating a desire to provide a subjective user reaction 
to the particular web page as a whole, the second icon 
providing the user an opportunity to provide a subjec- 
tive user reaction to the particular web page as a whole; 
and 

using software associated with the second icon to receive 
the subjective user reaction to the particular web page 
as a whole for reporting to a website owner. 

8. A system for measuring a subjective user reaction 
concerning a particular web page of a website, comprising: 

a first icon viewable on the particular web page indepen- 
dent of input from a user subsequent to the user 
accessing the particular web page, the first icon solic- 
iting a subjective user reaction to the particular web 
page as a whole from the user independent of input 
from the user subsequent to the user accessing the 
particular web page, the first icon operable to receive 
user input indicating a desire to provide a subjective 
user reaction to the particular web page as a whole, the 
user input causing a second icon to become viewable 
on the particular web page, the second icon comprising 
a multi-level rating scale for rating the particular web 
page as a whole, the multi-level rating scale including 
at least one positive rating, a neutral rating, and at least 
one negative rating; and 

software associated with the second icon and operable to 
receive the subjective user reaction to the particular 
web page as a whole for reporting to a website owner. 

9. A method of measuring a subjective user reaction 
concerning a particular web page of a website, comprising: 

using a first icon viewable on the particular web page 
independent of input from a user subsequent to the user 
accessing the particular web page to solicit a subjective 
user reaction to the particular web page as a whole from 
the user independent of input from the user subsequent 
to the user accessing the particular web page, the first 
icon operable to receive user input indicating a desire 
to provide a subjective user reaction to the particular 
web page as a whole; 

causing a second icon to become viewable on the par- 
ticular web page in response to receiving the user input 
indicating a desire to provide a subjective user reaction 
to the particular web page as a whole, the second icon 
comprising a multi-level rating scale for rating the 
particular web page as a whole, the multi-level rating 
scale including at least one positive rating, a neutral 
rating, and at least one negative rating; and 

using software associated with the second icon to receive 
the subjective user reaction to the particular web page 
as a whole for reporting to a website owner. 

* * ♦ * * 
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